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ABSTRACT 

Funded by the Bureau of Adult, Vocational, and 
Technical Education of the Office of Education, the Adult Performance 
Level (APL) study has as its objectives: to describe adult functional 
literacy in pragmatic, behavioral terms and to develop devices for 
the assessment of literacy which vill be useful at a variety of 
operational levels. Tvo years of research has led to three 
conclusions: literacy is a construct which is meaningful only in a 
specific cultural context; literacy is tvo*dimensional, rather than 
uni*dimensional; and literacy is a construct which is directly 
related (in a mathematical sense) to success in adult life. To define 
success the APL uses an index which is a composite of income, level 
of education, occupational prestige, and a measure of expressed 
personal satisfaction with one's vocation and general status in life* 
In order to estimate population parameters and to perform a final 
validation of the items and objectives, a national survey on the 
areas of occupational knowledge and consumer economics, conducted by 
Opinion Research Corporation according to APL specifications, has 
just been completed. The results suggest that far more adults are 
"illiterate," in the sense of being able to apply skills to problem 
areas which are derived from pragmatic adult requirements, than was 
expected. (WR) 
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FUNCTIONAL LITERACY FOR ADULTS 
A STATUS REPORT OF TOE ADULT PERFORMANCE LEVEL STUDY 

Introduction and Objectives 

Funded by the Bureau of Adult, Vocational, and Technical Educa- 
tion of the Office of Education, the Adult Perfoimance Level (APL) 
Study has as its objectives: (1) to describe adult functional literacy 
in pragmatic, behavioral terms, and (2) to develop devices for the 
assessinent of literacy which will be useful at a variety of operation- 
al levels. 

Theoretical Framework - Toward a Definition of Adult Literacy 

Since Septeniber of 1971, the APL (Adult Perforaiance Level] Study 
has been analyzing the coit^wneiits of adult literacy as a prerequisite 
to constructing more useful measures of adult literacy. Two years of 
research has led to three crucial conclusions: 

1. **Literacy'is a construct vAiich is meaningful only in a speci- 
fic cultural context . A corollary of this conclusion is that, just as 
literacy is culture-bomd, it is perhaps even more closely bound tc the 
technological state of a particular culture . The person vtfio is **literate" 
in one culture may be **illiterate" in another. Furthermore, as tech- 
nology changes, the requirements for literacy change. 
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This conclusion has tremendous inplications for the assessment 
of literacy. It is obvious that any coirplex society, such as that 
of the United States, is composed of many different subcultures. In 
this country, we give these subcultures ethnic tags, such as "Black", 
"Chicano", "White", "Oriental", and "Indiari'; or demographic tags, 
such as "rural" or "urban"; or geographic tags, such as "Southern" or 
"Northeastern"; or religious tags, such as "Catholic", "Protestant", 
or "Jewish"; or even tags viiich are combinations of some of those 
mentioned above, such as "Southern rural Black"^ "Wliite Anglo-Saxon 
Protestant", or "Urban Jew", or "Appalachian poor White," 

The question then becomes, is it necessary to develop a measure 
of literacy vdiich is unique to each subculture, or ran a single mea- 
sure \diich identifies cultural requirements vAxich are common to the 
preponderance of the population be created? Evidence gathered by the 
APL staff to date indicates that the latter strategy is most viable. 
Even though, for example, ethnic differences do exist on APL measures 
of literacy, the in5)ortant relationship . of literacy to different 
indices of success still holds true within ethnic groups. More will be 
said about this relationship in conclusion 3. 

The second part of the first conclusion, that literacy is tech- 
nology-bound, means that any method of assessing adult literacy levels 
must provide for subsequent redefinition of both the content and the 
levels of literacy. Without this provision, we may very well find our- 
selves claiming that being able to track and kill the sabre-toothed 
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tiger is a requirement for adult literacy vrtien, in fact, there are no 
sabre-toothed tigers left to kill. The inplication, of course, is 
that literacy must be redefined as technology changes over time. 
The APL Study has developed a methodology vMch will allow for this 
redefinition. 

2 . "Literacy" d oes not consist just of a single skill, or even 
a set of skills. Literacy is two-dimensional, rather than uni-dimen- 
sional . Literacy is best defined as the application of a set of 
skills (dimension 1) to a set of general knowledge areas (dimension 2) 
which result from the cultural requirements that are inposed on mem- 
bers of a culture. The APL Study uses this two-diinensional model as 
the basic framework for generating the essential elements of adult 
literacy, v^ich are coping behaviors called ^^performance requirements" 
or "tasks". This model Is illustrated in Figure 1. 
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Figure 1. The APL Literacy Model 



APL research indicates that literacy is conposed o£ an applica- 
tion of the communications skills (reading > writing, speaking, listen* 
ing) , computation, problem solving, and interpersonal relations to the 
general knowledge areas of occupational knowledge, consumer economics, 
community resources, government and law, and health. For more details 
concerning these performance requirements, see Northcutt, et ad, The 
Adult Performance Level Study - First Annual Report , January, 1972. 

3. "Literacy" is a construct v^ich is directly related (in a 
mathematical sense) to success in adult life . This is technically not 
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a conclijsion o£ APL research, but is the basic operating assumption 
underlying all APL research activities. However we define literacy, 
we expect more literate adults to be more "successful". After all, 
if we did not expect this relationship to be true, why attempt to in- 
crease the level of literacy in the first place? 

But vAiat is meant by "success"? To some, being successful means 
getting a job to others, it may mean losing a job. To some, success 
means getting off a welfare roll-- to others, success may mean 
arranging things so that one receives a larger welfare payment. To 
some, success means learning to read well enough to understand a want 
ad in a newspaper - -to others, success may mean reading well enough 
to score high enough on the Law School Examination Test to be admitted 
to the country's most prestigious law school. And to some, success is 
equated with becoming ir^ore "self-actualized" while to others, success 
may mean simply being able to stay alive for another week. 

The litany could continue indefinitely, and each example could 
give a plausible e>iplanation of success. The APL Study has drawn from 
a variety of educational, sociological, economic and behavioral studies 
to analyze different criteria of success. Based on this experience, 
the APL Study uses an index which is a coii?)osite of: (1) income; 
(2) level of education; (3) occi;^ational prestige; and (4) a measure of 
expressed personal satisfaction with one's vocation and general status 
in life (irreverently referred to by some APL staff as the "happiness 
index") . 
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The assunption that literacy is directly related to success also 
has great inplications for developing a measure of literacy. The 
assunption inplies that not only nrust the measure be derived from per- 
formances which are taken from the adult milieu (rather than from an 
elementary or secondary school frame of reference) , but that perfor- 
mance on such a me'^'^vxre must be positively correlated to success. The 
APL Study has di sloped a pool of objectives -based items, keyed to the 
APL skills and general knowledge areas outlined in 2 above, \Aich have 
been shown to be positively correlated to different measures of adult 
success . 

Current Research - A National Survey of Adult Perf otmaiice in Two Gen- 
eral Knowledge Areas 

As mentioned earlier, the APL Study has developed a system of 
adult literacy objectives and accon5>anying test items which are keyed 
to the four APL literacy skills and the five APL general knowledge 
areas. In order to estimate the population parameters and to perform 
a final validation of the items and objectives, a national survey on 
the areas of Occtpational Knowledge and Consumer Economics has just 
been conpleted. (National data for the other three areas will be col- 
lected during the remainder of 1974.) The following is a brief summary 
of the survey design: 

General Methodology - The survey was conducted by Opinion Research 
Corporation, Princeton, New Jersey, according to specifications set by 
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the APL staff.,. ORG formatted and printed field materials for admin- 
istration of the items to nationwide sairples of adults by inter- 
viewers. ORG prepared instructions for interviewers, superdsed the 
field work, edited the correctness of respondent's performance on a 
number of tasks called for in the test, and reproduced results on 
punch cards and magnetic tape. Testing started on Decenier 8, 1973, 
and was conpleted on January 29, 1974. 

Sanple Design 
Description of the Master Sanple 

The ORG Master Probability Sample is designed to represent the 
continental United States, excluding Alaska and Hawaii. 

In its basic design the sample consists of 360 counties, arranged 
in six "blocks" of 60 counties each. Each of the six blocks is an in- 
dependent siibsanple representing the United States. The counties 
making t^) each block were chosen at random with probability proportional 
to size of population from the 3,070 counties that made \jp the nation 
at the time the sanple was drawn. 

Prior to the selection of sample counties, geographical strati- 
fication was introduced. All 3,070 counties were groiq)ed into 171 
areas of contiguous counties, as designated by the Office of Business 
Economics of the U.S. Department of Commerce. The 171 area groupings 
were then arranged in geographical order from north aiid east to south 
and west from Maine to California and within each area the counties 
were arranged in descending order of population/ 
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Within the resulting array the 60 individual sample counties 
making up each block were selected by systematic methods, with random 
start points, to insure representative geographical distribution. 
The process was carried out six tiines to provide the six blocks that 
make xxp the entire master sairple. The selections were made, and docu- 
mented, on an IBM 360/65 digital conputer. 

It will be noted that in this process the sampling unit is a 
county , and that a given county may appear in the san5)le more than 
once, either because of its large population or because it was selected 
by chance in more than one of the six blocks. 

The sanple is updated aimually to reflect changes in population. 
The latest updating reflects 1973 population estimates. 

The sanple has a number of desirable properties: 

1. It can be used as a whole, or siibsanples can be taken by 
choosing any one or any confcination of the six blocks into which the 
master sanple is divided. Each of the six blocks is itself a national 
probability sanple. Such subsanples are mutually consistent, and can 
be added or conpared. This layout for the master sample provides flex- 
ibility in size, so that sanple size in each instance can be varied to 
suit the need for precision of any particular research inquiry. 

2. The whole sa3i?)ling method is both statistically and adminis- 
tratively of maximum efficiency. Its intent is to provide the most 
reliable data from any given e3q)enditures . 

3. The sauple is fully documented, and reproducible in a scienti- 
fic sense. It can be updated in a strai^t- forward way, easily and 
logically, as the population changes with time. 
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Within each county a minor civil division was selected, with 
probability proportionate to size,, and defined to be the primary 
sanqpling unit. 

The procedure consists of selecting a listed household using Ten- 
dom techniques. Nonoverlapping telephone directories are used for 
locating starting points. No interviews are conducted in these house- 
holds, for the interviewer begins her screening at the household im- 
mediately to the left of the listed one. 

Each starting point effectively deterjTiLnes a neighboriiood in 
which interviewing will be conducted. Since there is local variation 
in the incidence of listed households, weighting is introduced to 
equalize the prcjbabilities of selecting starting points. 

Note that, although telephone directories are used to locate 
starting points in the field interviewing, the sanple is in no sense 
a sample of telephone-owning households. Nontelephone households are 
included in their correct proportions, and the sample is properly rep- 
resentative of all segments of the United States population. 
Application of the Master Sanple to the API Study 

The universe for the two test administrations was defined as the 
nationwide population 18 through 65 years of age, living in households, 
who are jdiysically able to read and write. 

Three blocks of the master sanqple, 60 locations in each, were 
enployed in the study. In each of these 180 locations two starting 
points were selected, one for the Occipational Knowledge Test and one 
for the Consumer Economics Test. 
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In each location a fixed nuni)er of housing units were assigned 
for contact, beginning at the housing unit adjacent to the starting 
point and continuing on a fixed route. 

Within households, respondents wre selected for testing following 
probability sanpling procedures. 

to two calls were made at eadi household, \diere necessary, to 
coTtplete ^che test with the designated respondent. 

At the conclusion of each test, respondents were asked the likeli- 
hood of their being away from home at the time of the interviewer's 
visit. This information provided ixiput for a weighting procedur::: that 
corrects for "at-homeness." 

As an incentive for cooperation, respondents were given silver 
dollars in presentation cases. 
Weighting 

Weighting was introduced to correct for; 

• local variation in the incidence of telephone listed 
households 

0 different probabilities of selecting respondents in 
households with varying nunfccrs of eligible respondents 

• the probability of a respondent's being at home at the 
time of the interviewer's visit 

• varying conpletion rates in certain subgroiq)s of the 
population: region, education, family income, age 
and sex. 
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Selected Survey Results - Analysis of the survey data has only 
just begun, and a conplete report is still several months away. How- 
ever, the following is a suirenary of results for a portion of the items 
dealing with the general knowledge areas of occupational knowledge and 
consumer economics (precision is 4% at a 95% confidence interval) . 

17 percent of the sanple was not able, givan a series of four 
newspaper "help wanted" advertisements, to determine \iiich one was 
placed by a private person, rather than a corporation or public insti- 
tution. This result yields an estimated 20,071,000 adults who are not 
able to perfom this task, 

— Given monthly eamiiigs statement containing the gross salary, 
deductions by type, and net salary, only 74 percent of the sanple was 
able to determine the total amount of deductions. Further, 33% of the 
sanple, or a projected 38,960,000 persons are not able to interpret the 
eaniings statement well enough to locate the deduction for social 
security. 

--- Thirty-six percent of the sanple, given a W-4 fom and infor- 
mation concerning the number of dependents, were unable to read, write, 
or con?)ute well enough to enter the correct number of exenptions in the 
appropriate block of the form, 

— Only 56 percent of the saniple, \iien given a series of news- 
paper "help wanted" advertisements, were able to correctly match per- 
sonal qualifications to job requirements • These results produce an esti' 
mated 52 million adults viho are not able to perform the task as required 
by the survey. 
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— When given an inconplete business letter, only one-fith o£ 
the sanple was able to conplete the "return address" section without 
making an error in form, content, spelling, or punctuation. 

TWenty-two percent o£ the sairple was unable to address an 
envelope well enough to insure it would reach the desired destination, 
and twenty- foiir percent was unable to place a return address on the 
same envelope which would insure that it would be returned to the 
sender if delivery were not possible. These results indicate that 
an estimated 26-28 million adults aren't able to address an envelope 
well enou^ to insure the letter will not encounter difficulties in 
the postal system. 

— About one-fith of the sanple could not read an "equal oppor- 
tunity" notice well enough to identify a verbal statement which de- 
fined its meaning. 

— About one-fourth of the sajiple, or a projected 26 million 
adiilts, could not distinguish the terms "gross" and "net" correctly 

\dien given a sijiple situation involving total pay and pay after deductions. 

— Almost one-fifth of the sanple, or a projected 22^1 million adults, 
weren't eliie to read and interpret a tabular payment schedule well 
enough to determine the monthly payment for a given amount of indebtedness. 

— A surprising 73% of the sample, or a projected 86 million 
adults, weren't able to accurately calculate the gasoline consunption 
rate of an automobile, given odometer readings and fuel consunption. 

Less than 401 of the sanple i^en given a catalogue advertise- 
ment series of "for sale" ads ^ich contained a notice for the same 
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^pliance, was able to correctly calculate the difference in price 
between a new and used appliance. 

— More than three-fourths of the sanple was unable to read, 
write, and conpute well enough to correctly enter one total cash price 
for a mail order, given an advertisement with price information and 

a mail order foim. 

TWenty-nine percent of the sanple, or a projected 34.2 
million adults, were unable to order a meal for two persons not ex- 
ceeding a set amount, given a restaurant menu. 

— Slightly more than one-fifth of tlie sanple, or a projected 
25.9 million ad*alts, were unable to write a check on an account \nth 
out making an error so serious that the check would not be processed 
by the bank, or wuld be processed incorrectly. 

— Only two-thirds of the sample was able, given three boxes of 
cereal displaying the name, net weight, and total price of the contents, 
to determine the brand vdiich had the lowest unit cost. 

— Over forty percent of the sanple, or a projected 48.4 million 
adults, was unable to determine the correct amount of change on a pur- 
chase, given a cash register receipt and the denomination of the bill 
used to pay for the purchase. 

Future Research 

These results, with the results from dozens of other tasks not re- 
ported here, would suggest that far more adults are **illiterate", in 
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the sense o£ being able to apply skills to problem areas vAiich are 
derived from pragmatic adult requirements, than one mi^t expect. 
As was noted earlier, a second national adult survey o£ perfonnance 
on tasks keyed to the other three APL general knowledge areas will 
begin shortly • When this phase is conqpleted, the set of objectives, 
"test items", and national estimates of adult perfonnance related 
to these objectives should be a valuable resource for planning, 
developing, or evaluating educational programs on a variety of levels. 
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